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Generation of Linearized Halftone Matrix," as identified above. 

It is hereby asserted that the invention was conceived and actually reduced 
to practice in the United States or Spain prior to March 7 th , 2000. 
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Please submit this disclosure to the HP Legal Department as soon as possible. No patent protection is possible until 
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proposed announcement, offer to sell or sale of the product: ^ ___ 
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b. Prior solutions and their disadvantages (if available attach copies of relevant technical articles or patents). 

c. Description of the construction and operation of the invention (include appropriate schematic, block and timing 
diagrams; drawings; samples; graphs; flowcharts; computer listings; etc.) . 

d. Advantages of the invention over what has been done before. 
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Dynamic Generation of a Linearized Halftone Matrix 

Invention Disclosure 



Will Allen, HP BCD 
Johan Lammens, HP BCD 



Problem 

It is desirable, from performance and image quality standpoints, to have a halftone matrix that is 
linear. Linear means the system response (e.g., CIE L*) is linear with respect to digital counts input 
to the halftoning module. Since system response varies (environment, print cartridge set, medium, et 
cetera), it is desirable to have the ability to very the linearization depending on the state of the system. 

A classic technique involves using a look up vector to change the input data before halftoning. The 
vector is changed depending on the linearization required This technique often introduces unwanted 
contouring in the output plot If the conation is strong, unique states of the input data are lost. For 
example, applying a gamma correction of 2.0 to 8-bit data causes l A of the 256 unique states to be lost! 

Another approach is to generate a halftone matrix that is inherently linearized with respect to a given 
set of conditions. Since conditions vary, the matrix must be generated from time to time after the 
product leaves the factory. Some forms of halftone matrices are expensive, in terms of time and/or 
memory, to generate, thereby rendering them ill-suited to dynamic (in the product) generation. 

Using a pre-defined matrix is not reasonable, as it would be prohibitive to store pre-defined matrices 
for all possible linearizations in the printer. 

The invention details a scheme applicable to any type of traditional threshold matrix based halftoning 
that will rapidly generate a matrix with a given response (linearization) in terms of number of dots as 
a function of input in digital counts. 

Outline of Invention 

The idea is to obtain (generate, leverage, buy) a 16-bit traditional threshold matrix and store it in the 
printer in a special modified format. Let's call this special format a level vector. When needed, a 
traditional 8-bit threshold matrix is rapidly generated, with any given linearization, from the level 
vector data and a second vector specifying the desired linearization. 

Translation to Level Vector Form 

Although applicable to other size matrices, the example given here will be a 256 x 256 element 
matrix. 

The first step is to obtain a traditional 256 x 256 x 16-bit threshold matrix and convert it into a level 
vector. Each element in the matrix is a 16-bit word, and can encode one of 2 16 (65,536) different 
threshold values. This can be done with any means desired, and the style (Bayer, screen, et cetera) of 
the matrix is not important. The matrix has 2 16 elements, and can therefore represent 2 16 + 1 unique 
numbers of dots. Each number of dots can be thought of as a level 

In a traditional threshold matrix, the positions of data in the matrix represent a positions on the page, 
while the values represent thresholds or levels. The new form stores the same information as a vector. 
The index, or position, in the vector indicates the threshold value, while the data stored under each 
index indicate the x mdy coordinates, in the traditional threshold matrix, of the pixel "turned on" at 




Here is a traditional threshold matrix. For simplicity a 4 x 4 matrix will be shown andtranda^ into 
. i ;»^,r ThTnrocess is easily generalized to a matrix with larger dimensions. The numbers 

of the cells. 
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Here are the same data represented as a level vector. The x data and y da* columns are simply the 
ZZZ -SZ threshold value in the traditional table above that has the same vake as the Index of 
toc^S e rlix in the level vector. The bold box surrounds the W data in both forms. 
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The 4 x 4 traditional matrix is comprised of 16 8-bit values. It occupies 128 bits of ^memory. The 
level ^itorconsists of 32 4-bit values and also occupies 128 bits of memory. No extra memory is 
required for the level vector. 

Comeback to the 256 x 256 x 16-bit case, we see the traditional threshold matrix has 2 16 16-bit 

occupies 2" bytes of memory. The same data, in a level vector, require 2 
entries each composed of 2 8-bit values, or 2 bytes. 

Dynamic Generation of 8-bit Traditional Matrix 

AEeneralformofthelMearization 

demenSS the number of dots tote "tumed-on" at the halftone W^f%*£*> g bit 
co^nding to the index. For example, if the entry at index 13 was 873, then 873 dots m the 8-bit 
threshold matrix would be at or below the threshold value of 1 3. 

To generate the 256 x 256 x 8-bit linearized matrix, one needs only to sequence *««gtte 
hnearization vector. If the 1" element of the lir^rizauon vector contains ^Sft^SnL 
locations specified by the level vector are assigned threshold value 1. For the 2 elementinthe 
SS o^Wwe'll assume the value is 47. The next 35 (47 - 12) locafons specified by the 
^ew2 raTisigned threshold value 2. This is repeated until all the values in the 
!Sor have been processed, thereby assigning a threshold value to all the cells m the 256 x 256 x 8-b,t 
matrix. 
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Advantages 

• The level vector is easily computed by translation from a traditional 16-bit threshold matrix. It 
occupies the same amount of memory as the traditional matrix. 

. The technique is applicable to any style of halftoning that can be represented in a traditional 
threshold matrix, including matrices purchased from third parties. 

• Image quality is improved by eliminating contouring caused by vector based linearization applied 
before halftoning. 

. Execution time and halftoning-time complexity are reduced when compared to vector based 

linearization applied before halftoning. 
. Generation of the 8-bit threshold matrix is fast, and occurs in a deterministic amount of time that 

is almost completely independent of the data stored in the level and linearization vectors. 

• A single level vector can be used to generate all 8-bit threshold matrices needed by the printer. 
This reduces storage requirements. 

. The scheme is compatible with dynamic compensations systems such as Canguro s Closed Loop 

Color. 
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HT Color Tuning 

Johan M. Lammens 




Calculate four ID transfer funcitons (C,M,Y,K) to minimize the color difference between two halftones, using the same 
ink, media, printmode, and printer, without affecting any other part of the system (color maps etc). 

1 . Using 1 D transfer functions calculated from 4D profiles 

Based on full colorimetric characterization (ICC profiles) and numerical minimization of color differences. 




Create a 9 A 3 RGB sampling and save as raw image, to be transformed to CIELAB by PhP or so using AC intent; this will 
be the forward table used to characterize a given HT. This roundabout way of creating an AC forward table is for lack of a 
tool to extract it directly fromt an ICC profile. Note PhP uses inverted coding for CMYK (255=0%). 




Read the corresponding Lab values for reference and new HT 
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Construct a 3D interpolation (RGB->Lab map) using Mathematical standard 3rd order interpolation, for both the reference 
HT and the new HT. It should be possible to use the measured data directly to do this. 

SetOptions[ListInterpolation, Interpol a tionOrder -> 1] ; 



HT color tuning RGB:nb 




PJot primary and secondary ramps in ab space and dE from paper for primary ramps, for reference and new HT. 



HT color tuning RGB.nb 



4 




plref = PlotRampsRGB[refmod] 




- GraphicsArray - 

plnew =t PlotRampsRGB[newmod] 




- GraphicsArray - 
Now show the two together, to appreciate the difference better. 
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0.05 0.1 0.15 0.2 0.25 0.3 0.35 
{0., 0.158767,. 0.351407, 0.152195, 0.0743582} 
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{0.126667,- 1.75705, 9.99575, 1.55574, 1.11485} 



Gray balance the new HT while matching the color of the reference HT, using only the CMY planes. Using all four planes 
does not work well; the numerical minimization becomes unstable because the CMYK->Lab mapping is not unique (1- 
to-1). Mind the accuracy and precision goals - since we're working in dE space it makes no sense to use the default 10 bits 
or so; this would only cause the minimization to thrash about needlessly. Use only one of the three alternatives below: 
optimzing r s g,b separately; only r,g assuming b=r; or only r, assuming g=b=r. 

Optimizing r,g,b separately 




Optimizing r,g and assuming b=r 




Optimizing r and assuming g=b=r 



HT color tuning RGB Mb 
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Caculate color differences over an ll A 3 RGB target before and after linearization (color correction), but without reprinting 
and remeasuring yet, and using the models rather than the measurement data. 



HT color tuning RGB. nb 
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- Graph icsAr ray - 

Show reference and result together. Note that there may be small difference induced in the indidvidual ramps in order to 
minimize the differences in the gray balance. Simple ID linearization of the primaries alone would probably make the 
primary ramps match better, but potentially at the cost of gray balance and overall color matching. 



HT color tuning RGB.nb 
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- GraphicsArray - * 

At this point we could write out a new set of "measurement" data to create a new profile corresponding to the 
linearized/color corrected HT. It doesn't have to be in IT8 form; since we can just turn the model crank we can generate an 
arbitrary number of samples, e.g. 1 1 A 4 (which would be rather time consuming to actually measure). That is, if you have 
faith in the model ;-) . 

The tranfer functions could be put into the new profile as output tables, but it's better to build them right into the (matrix) 
HT to avoid losing gray levels, especially if a higher bit depth (10 or 12b) version is avaiable to convert down to 8 bits 
while massaging the histogram to tit the required linearization. For non-matrix HTs this is more tricky. 

Finally, after applying the linearizations to the new HT and reprinting the IT8 target with it, read in the measured Lab 
values and compare to the reference ones. This is the ultimate test for how well the model works, of course. If all is well, 
the results should be comparable to the ones above, which were obtained from the models only (without measurements). 



HT color tuning RGB.nb 
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{0.126667, 1.75705/9.99575, 1.55574, 1.11485} 



Select the parts of the IT8 target that are below the global ink limit for the device/ink/media under consideration, to get a 
more realistic picture of the color differences one might see in practice. 




{0.126667, 1.75705, 9.99575, 1.55574, 1.11485} 
Sort the samples by descending dE to get an idea of the worst case colors 
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0 5 10 15 20 25 



- DensityGraphics - 

2. Using 1 D transfer functions calculated from 1 D ramps 

Now compare what the result would be using traditional ID linearizations, using the model data only (no measurements), 
define the input dot percentages for a 9x21 characterization target 




generate CIELAB data for reference and new HT, using their respective models, and convert to dE from paper 



HT color tuning RGB.nb 




Now calculate linearization functions, using a quick and dirty numerical function inverse of interpolated functions. Varying 
the interpolation order will determine the smoothness of the resulting transfer functions. 
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Caculate color differences over the IT8 target before and after linearization (color correction), but without reprinting and 
remeasuring yet, and using the models rather than the measurement data. 




Previous result with gray balancing: 




. 1. 2. 3. 4. 5. 6. 

{- Graphics 1,67048, 6.39818, 1.46681, 1.09276} 

New result with ID linearizations: 




2. 4. 6. 8. 10. 

{-Graphics-, 2.12956, 11.1837, 1.75619, -1.51653} 
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HT dot distance 

Johan M. Lammens 



Read calculated dot distance profile from file; this one is for Canguro's default m256Jin BN halftone (calculated off-line 
with /users/lammens/Canguro/Correctdither/distprofile.c). Return value is a list of measured distances (in pixels), the data 
matrix, and interpolated functions per plane for number of pixels, cumulative pixel area, and average number of pixels at 
each distance, as a function of normalized digital count in [0,1]. 



ht dot distance, new. nb 
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The first part of the result is the vector of measured distances: discrete and step- wise because of the regular grid of the the 
HT, and measured in pixels. 

ListPlot[dist,PlotRange->{0,Max[dist] }] ; 

5r 



4 




2 



1 - - 

0 2 4 6 8 10 12 

This plots the number of pixels and cumulative pixel area as a function of normalized digital count, for the first plane of the 
HT 

Plot[#[c] ,{c,0,l},PlotRange->All]& /@ Take[fns[ [1] ] , 2] ; 

1750r 
1500 
1250 
1000 ■ 




0.2 0.4- 0.6 0.8 1 



The cumulative pixel area is effectively the dot histogram of the halftone. Note that Alp halftones are in fCCMY plane 
order. This HT is pre-linearized. Note also that the number of pixels added for each consecutive level becomes quite 
irregular near the shadow end, although the cumulative area goes up smoothly and monotonically. 



ht_dot_distance.new.nb 
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The following plots show the number of pixels at each measured distance, as a function of normalized digital count, for the 
first plane, and a ciose-up around 50% pixel area. The effect of BN is visible as fluctuations around the monotonically 
increasing trend. 




Function to return total simple and overlapped area coverage based on dot profile, normalized input digital count (nominal 
area coverage), and normalized dot size (expressed in square pixel diagonals). 




-0.4 
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HT pre-linearization 

Johan M. Lammens 




Read an N-bit HT matrix (N>8) and a desired dot profile (linearization function), and generate an 8 bit version of the HT 
with that dot profile. 

Read the HT matrix: single plane, 16 bit little endian encoding 




library files location 




Read input HT: 8, 16, or 32 bit encoding 



HT pre-linearization. nb 




Optional: invert the thresholds in case there is doubt about additive vs subtract! ve interpretation 




Display in 2D matrix form 




0 50 100 150 200 250 



Write out in Alp monochrome form and for FFT analysis 




build input histogram 
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1000 2000 3000 4000 

{3.11667 Second, {{4096}, 65536}} 

shortcut to. histogram for dot-linear HTs 




normalize by total dot area and replot 




Read calculated dot distance profile and histogram from file; this one is for Canguro's default m256Jin BN halftone 
(calculated off-line with /usei^lammens/Canguro/Correctdither/distprofile.c). Return value is a list of measured distances 
(in pixels), the data matrix, and interpolated functions per plane for number of pixels, cumulative pixel area, and average 
number of pixels at each distance, as a function of normalized digital count in [0, 1], 



HT pre~linearization. nb 




select the appropriate plane's dot histogram and plot it - note that the order is KCMY (for Alp) 




100 

50 100 150 . 200 250 

{{256}, 65536} 

normalize by total dot area and replot 



HT pre-linearization.nb 



Write out the normalized dot (threshold) histogram and cumulative histogram as real vectors 




Build a mapping from 16 to 8 bit threshold values, based on the two histograms. 




1000 . 2000 3000 4000 

0 

test some values along the tone curve, specified in % ink 




create the new 8 bit HT and check the dot histogram and grayscale representation 



HT pre-linearization.nb 




0 50 100 150 200 250 



Write out the new HT to file 



HT format conversions, nb 
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Convert raw format threshold matrices to Alp and other 
formats. 



Johan M. Lammens 




Raw to Alp monochrome format 




Read input HT, 8 or 16 bit 




Display in 2D matrix form 




0 50 100 150 200 250 



Write out in Alp monochrome form and for FFT analysis 



HT format coftversiom.nb 
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Display in 2D matrix form 



HT format conversions, nb 




HT format conversions. nb 



4 





Alp format to raw 



HT format conversions. nb 




0 50 100 150 200 250 




0 50 100 150 200 250 



Note HPGL plane order is KCMY; rotate the planes before writing if 4-plane matrix! 
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HT Color Tuning 

Johan M. Lammens 




Calculate four ID transfer funcitons (C,M,Y,K) to minimize the color difference between two halftones, using the same 
ink, media, printmode, and printer, without affecting any other part of the system (color maps etc). 

1. Using 1 D transfer functions calculated from 4D profiles 

Based on full colorimetric characterization (ICC profiles) and numerical minimization of color differences. 




Create an 1 1*4 CMYK sampling and save as raw image, to be transformed to CIELAB by PhP or so using AC intent; this 
will be the forward table used to characterize a given HT. This roundabout way of creating an AC forward table is for lack 
of a tool to extract it directly fromt an ICC profile. Note PhP uses inverted coding for CMYK. (255=0%). 




Read the same image back, converted to Lab using and external CMM and ICC profile corresponding to the reference and 
new HT using the same device configuration. Convert from PhP raw to Lab coding. PhotoShop Lab range is [0,100], 
[-128,127], [-128,127], mapped to 8 bit values as [0,255], with 0->128 for a and b. 



i 
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Construct a 4D interpolation (CMYK->Lab map) using Mathematical standard 3rd order interpolation, for both the 
reference HT and the new HT. It should be possible to use the measured data directly to do this, but I haven't figured out 
how to deal with the non-uniform sampling of the IT8 target yet. 
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- GraphicsArray - 
Now show the two together, to appreciate the difference better. 



5 




- GraphicsArray - 



Compare model calculated values to the original IT8 measurements to get an idea of the accuracy of the interpolated model. 
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0.25 0.5 0.75 1. 1.25 1.5 1.75 
{0.125059, 0.942216, 1.9738, 0.909561, 0.399198} 




0.5 1. 1.5 2. '2.5 



{0.065127, 0.983044, 2.50497, 0.920793, 0.450623} 

Gray balance the new HT while matching the color of the reference HT, using only the CMY planes. Using all four planes 
does not work well; the numerical minimization becomes unstable because the CMYK->Lab mapping is not unique {1- 
to-1). Mind the accuracy and precision goals - since we're working in dE space it makes no sense to use the default 10 bits 
or so; this would only cause the minimization to thrash about needlessly. 



HT color tuning.nb 
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Now do a constrained (by CMY) black matching, and interpolate the resulting four tables to give a set of transfer functions. 
Fix CMY at 33% each (remapped through the CMY transfer functions), to approximate a typical GCR color to black ratio. 
The minimization seems to be quite sensitive to the level of CMY chosen; 33% seems to work well, although in principle 
any fixed or even variable level could be used. Mind the total ink limits also; don't do this with ink levels going up to 
400%, because they will most likely never be printed. 




- Graphics - 



Write the resulting tables out in Mathematica, ABS ScreenMaker and/or dot histogram format 



HT color tuning.nb 




Caculate color differences over the IT8 target before and after linearization (color correction), but without reprinting and 
remeasuring yet, and using the models rather than the measurement data. 




5. 10. 15. 20. 25. 

{-Graphics-, 15.2487, 27.1001, 15.5054, 4.71004} 
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1. 2. 3. 4. 

{-Graphics-, 1.50621, 4.2428, 1.44782, 0.731442} 

Plot primary and secondary ramps as before, but after applying the linearization functions. 




- GraphicsArray - 

Show reference and result together. Note that there may be small difference induced in the indidvidual ramps in order to 
minimize the differences in the gray balance. Simple ID linearization of the primaries alone would probably make the 
primary ramps match better, but potentially at the cost of gray balance and overall color matching. 




HT color tuning.nb 




- GraphicsArray - . 

At this point we could write out a new set of "measurement" data to create a new profile corresponding to the 
linearized/color corrected HT. It doesn't have to be in IT8 form; since we can just turn the model crank we can generate an 
arbitrary number of samples, e.g. 1 1 A 4 (which would be rather time consuming to actually measure). That is, if you have 
faith in the model 

The tranfer functions could be put into the new profile as output tables, but it's better to build them right into the (matrix) 
HT to avoid losing gray levels, especially if a higher bit depth (10 or 12b) version is avaiable to convert down to 8 bits 
while massaging the histogram to fit the required linearization. For non-matrix HTs this is more tricky. 



Finally, after applying the linearizations to the new HT and reprinting the IT8 target with it, read in the measured Lab 
values and compare to the reference ones. This is the ultimate test for how well the model works, of course. If all is well, 
the results should be comparable to the ones above, which were obtained from the models only (without measurements). 
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1. 2. 3. 4, 5. 6. 

{0.0331662, 2.31874, 6.36356, 2.26201, 1.17569} 



Select the parts of the IT8 target that are below the global ink limit for the device/ink/media under consideration, to get a 
more realistic picture of the color differences one might see in practice. 




1. 2. 3. ■ 4. 5. 6. 

{0.0331662, 2.25058, 5.95154, 2.18417, 1.13724} 



Sort the samples by descending dE to get an idea of the worst case colors 




The following plot shows the samples with the least color differences at the top, the worst at the bottom, each colored with 
the corresponding CMYK color. 
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DensityGraphics ■ 



2. Using 1 D transfer functions calculated from 1 D ramps 

Now compare what the result would be using traditional ID linearizations, using the model data only (no measurements), 
define the input dot percentages for a 9x21 characterization target 




generate C1ELAB data for reference and new HT, using their respective models, and convert to dEfrom paper 
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- GraphicsArray - 
Convert to {x 5 y} format data using the ramp values 




Now calculate linearization functions, using a quick and dirty numerical function inverse of interpolated functions. Varying 
the interpolation order will determine the smoothness of the resulting transfer functions. 



HT color tuning.nb 
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Caculate color differences over the IT8 target before and after linearization (color correction), but without reprinting and 
remeasuring yet, and using the models rather than the measurement data. 




Previous result with gray balancing: 



HT color tuning jib 




1. 2. 3. 4. 

{-Graphics-, 1.50621, 4.2428, 1.44782, 0.731442} 

New result with ID linearization: 




1. 2. 3. 4. 5- 

{- Graphics -, "1.78747, 4.97161, 1.69613, 0.874912} 

Plot primary and secondary ramps as before, but after applying the new linearization functions. 




- GraphicsArray - 

Show reference and result together. The primary ramps should match better than before. 




- GraphicsArray - 
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Default HT Linearization 

Johan M. Lammens 

Rough default linearization for scattered dot halftones like ED or BN, based on equation for 
deriving L* from Y/Yn, i.e. normalized weighted reflectance, with extensions for taking dot 
gain into account. 




HTJinearization.new.nb 
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100 

1 




0.2 0.4 0.6 0.8 1 



{1, 0.239307, 0} 

Calculate inverse of normalized L* function, taking boundary condition into account 




0.2 0.4 " 0.6 0.8 1 

-Graph ics - 



{0, 0.184187, 1} 
Plot L* from % ink, its inverse, and the composition of both 



HTJinearization. new. nb 
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{1, 0.5, 0} 

Lni is the function to use for dot growth to achieve approximately linear L*, not taking dot gain into account. An additional 
dot gain compensation can be applied as well. 

Fit a gamma function to the L* function, using RMS error over a non-uniform sampling (the fit is worse and probably more 
important in the highlights). 



HTJinearization.new. nb 
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0.2 0.4 0.6 0.8 1 



{{1, 1}, {0.621576 f 0-615114}, {0.481628, 0.48695}, 

{0.383458, 0.393014}, {0.305305, 0.316109}, {0.239307, 0.249808}, 
{0.181618, 0.190892}, {0.130031, 0.137484}, {0.0831514, 0.0883786}, 
{0.0400323, 0.04274-9}, {0., 0.}} 

Try the inverse gamma function as an inverse of the L* from % ink function: 




0.2 0.4 0.6 0.8 . 1 



{1, .0.964984, 0.841883, 0.719304, 0.604644, 0.495533, 0.390651, 
0.289158, 0.190481, 0.0942004, 0.} 

The gamma inverse is not as good, especially in the higlights, but it's a simpler function to use for the calculations below. 

Now let's look at the effect of dot gain: Dot gain is typically specified as percent apparent dot area increase at a 50% tint; 
try a gamma function to extrapolate to complete range. 



HTJinearization.new.nb 
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0.2 0.4 0.6 0.8 



-Graphics- 



This does not look like a good dot gain function; see e.g. ANSI-CGATS.6-1995 report. A quadratic function fit seems to 
work much better: 




0.2 - 0.8 (-0.5 + x) 
0.2 




0.2 0.4 0.6 0.8 



-Graphics-, 

Function to generate dot gain corrected % ink curves, i.e. linear plus dot gain. 



HTJinearization.new.nb 



6 




0.2 0.4 0.6 0.8 1 
-Graphics- 




0.2 0.4 0.6 0.8 1 



-Graphics- 

The hump is on the opposite side of the one obtained with the gamma function above; this seems to be a better model for 
actual dot gain behavior, similar to the one PhotoShop uses when specifying only the 50% point on the curve. But the 30% 
curve is non-monotonic, which is not admissible - find out where the non-monotonicity sets in: 




So the DG function should not be used with dot gain values higher than 25% (newsprint is 30%): 



HTJinearization.new.nb 
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0.2 0.4 "0.6 0.8 1 



-Graphics- 
Dot growth function for output linear in L* based on simple dot gain model and gamma function; 

first, L* as a function of digital count and dot gain. Typical press dot gains range from 8% for quality coated papers to 
30% for newsprint; SWOP coated is 20%. 




0.2 0.4 0.6 0.8 1 

-Graphics- 
Invert the L* function: 



HTJinearization. new.nb 




0.2 0.4 0.6 0.8 1 



{-Graphics-, -Graphics-, -Graphics-} 

To have no visible difference between digital counts differing by 1 (i.e. contouring), the difference in L* should be less 
than 1, the theoretical JND, or 0.01 when scaled to [0,1]. 

Plot normalized L* as a function of discretized 8 bit input, using the original L* function: 




0.2 0.4 0.6 . 0.8 1 



HT linearization, new. nb 



10 



l 




0.8 



. 0.6 



0.4 



0.2 



1 



{ -Graphics- , -Graphics- , -Graphics- } 



Contouring is clearly visible as a stair step pattern in the highlight region. Calculate the biggest step in L* between digital 
counts differing by 1, which should be the first step (in the highlights). As an example, try 20% dot gain, and calculate the 
corresponding dE (dL*) value. 




Function to determine the max dE between consecutive levels, given a certain number of bits of precision 




Find the number of bits required for a given maximum dE at a given level of dot gain, and plot linearity as a function of dot 
gain and bit depth. 



HTJinearization. new, nb 
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So finally it seems that in order to be able to visually linearize a halftone that is linear in the number of dots (like standard 
error diffusion) without risking any contoutring and taking a reasonable dot gain into account, we need at least 1 1 bits in 
the transfer function and in the halftone, the plots below visualize the solution found. 



HT_lineanzation.new.nb 
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0.2 0.4 0.6 0.8 1 • } 

'{^Graphics-, -Graphics-, -Graphics-, -Graphics-, -Graphics-} I 

i" 

■ j 

Conclusion 

To be safe, we need at least 11 bits of grayscale resolution when linearizing arbitrary halftones on reasonable media. To 
have some design margin and because it's easier to deal with in the digital domain, I'd recommend 12 bits. 



JML 



HT histogram.nb 




decoding functions for ASCIIHex format 




Read input HT, raw or asciihex format, possibly invert from additive to subtractive interpretation 



Display in 2D matrix form 



HT histogram, nb 




Calculate histogram and write to ascii file, mma format 



HT histogram.nb 
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